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Office Action Summary 



Application No. 

09/224,583 



Applicant(s) 

BEUTNAGEL ET AL. 



Examiner 

Michael N. Opsasnick 



Art Unit 

2655 



- The MAILING DATE of this communication appears on the cover sheet with the correspondence address 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )S Responsive to communication(s) filed on 15 October 2002 . 
2a)Q This action is FINAL. 2b)S This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 
Disposition of Claims 

4) ^ Ciaim(s) 1-34 and 36-70 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) E3 Claim(s) 1-28.31-34.36-40.43-51 and 57-65 is/are rejected. 

7) S Claim(s) 29.30.41.42.52-56 and 66-70 is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) O The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

11) D The proposed drawing correction filed on is: a)D approved b)D disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) D The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§119 and 120 

13) Q Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 

a£]AII b)D Some*c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 1 19(e) (to a provisional application). 

a) □ The translation of the foreign language provisional application has been received. 

1 5) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 1 20 and/or 121. 
Attachment(s) 

1 ) §3 Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-41 3) Paper No(s). . 

2) □ Notice of Draftsperson's Patent Drawing Review (PTO-948) 5) □ Notice of Informal Patent Application (PTO-152) 

3) □ Information Disclosure Statement(s) (PTO-1449) Paper No(s) . 6) □ Other: 
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DETAILED ACTION 



Declaration filed under 37 CFR 1.132 



1 . Examiner notes the Declaration filed under 37 CFR 1 . 1 32 and the clarification of the 
previously cited references therein. The arguments, presented in the declaration, were taken into 
consideration when the current claims were reviewed. 



Allowable Subject Matter 



2. Claims 29,30, 41,42,52-56, and 66-70 are objected to as being dependent upon a rejected 
base claim, but would be allowable if rewritten in independent form including all of the 
limitations of the base claim and any intervening claims. 



Claim Rejections - 35 USC § 103 



3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 
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4. Claims 1-28,31-34,36-40,43-51,57-65 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Applicant's Admitted Prior Art in view of Merrill et al (6181351) . 

Applicant's Admitted Prior Art (the prior art sections of applicant's spec, pp. 1-3, 
pertaining to the MPEG 4 standard) teaches a TTS stream input into a decoder, thru a 
synthesizer, and into a compositor (see Fig. 1 of applicant's specification). Furthermore, 
applicant's admitted prior art teaches FAPS and a FACE model into a FRM to be input to 
the compositor (Fig. 1). Applicant's admitted prior art also teaches the definition of the 
FAP's (pp 2 of applicant's specification), including 10 groups of parameters (ranging 
from different parts of the face, along with viseme information). The information with 
respect to the FAP's is used along with decoded audio information, to produce an 
animated video synthesized with the audio (applicant's admitted prior art, pp. 3, lines 22- 
26). 

{As a side note, throughout applicant's admitted prior art description on pps. 1-6 
of the specification, applicant stresses that the novelty of the instant invention is the use 
of phonemes, derived from the "tts stream decoder" output, generating FAPS to be input 
into the FRM, for eventual synthesis (applicant's specification, pp 2 lines 3-5, pp 4 lines 
10-11, and pp. 5 lines 3-5; and pp 6 lines 1-6).} 

To summarize, applicant's admitted prior art teaches a systems with a TTS stream 
into a decoder, synthesizer, and compositor, along with a face model and FAPS into the 
compositor such that the output of the compositor is a synthesized audio/visual, wherein 
the timing of the audio and visual information is derived from the streams (applicant's 
admitted prior art, pp 3 lines22-28). 
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Applicant's admitted prior art does not explicitly teach the use of phonemes, 
derived from the decoded output of the TTS stream, to provide more FAP information 
into the FRM (into the COMPOSITOR) for synthesis. Merrill et al (6181351) , however, 
teaches the derivation of phonemes from a TTS stream (using a transform) to influence 
the animation of the phoneme (col. 7 lines 20-25, and further described in col. 7 lines 45- 
51, col. 7 line 55 - col. 8 line 14). Therefore, it would have been obvious to one of 
ordinary skill in the art of speech animation to modify the teachings of Applicant's 
Admittted Prior Art, as explained above, with phoneme based animation information 
because it would advantageously produce an illusion of a mouth moving to generate the 
sounds heard by synchronizing audio playback of a phoneme with display of a mouth 
shape corresponding to the phoneme (Merrill et al (6181351), col. 7 lines 59-66). 
Examiner directs applicant's representative's attention furthermore to the details in 
Merrill specification as to the mappings (col. 13 lines 30-col. 14 line 8). 

As per claims 1 and 2,12,14,16,31,33 the combination of Applicant's Admitted 
Prior Art in view of Merrill et al (6181351) teaches a decoder responsive to an input 
signal comprising text and FAP information (applicant's admitted prior art), generating 
addition FAP information from phoneme information to add to the FAP information 
(applicant's 'Merrill modified' admitted prior art, as demonstrated above), and a face 
rendering module responsive to the face model and decoder output (applicant's admittted 
prior art) 
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As per claims 3,17,23,36, the combination of Applicant's Admitted Prior Art in 
view of Merrill et al (6181351) teaches FAP based command signals (applicant's 
admitted prior art) 

As per claim 4,34,37 the combination of Applicant's Admitted Prior Art in view 
of Merrill et al(61 81351) teaches prosody and timing information (Merrill, phoneme and 
timing information (col. 14 lines 65-68) 

As per claims 5,24,25, the combination of Applicant's Admitted Prior Art in 
view of Merrill etal (6181351) teaches basic FAPS (applicant's admitted prior art - non- 
viseme based, and other grouping of FAPS). 

As per claims 6-11,13,15,18,19,32, the combination of Applicant's Admitted 
Prior Art in view of Merrill et al (6181351) teaches sound, encoded voice, sound 
synthesizer, text, video synthesizer, and face model information (applicant's admitted 
prior art). 

As per claims 26-28, 38-40, the combination of Applicant's Admitted Prior Art in 
view of Merrill et al (6181351) teaches an interpolated signal including phoneme, timing, 
and command information (Merrill data structure, Fig. 4, the sound file containing the 
information, as applied to applicant's admitted prior art structure) 

As per claims 16,20-22,43 and 57, the combination of Applicant's admitted prior 
art in view of Merrill et al teaches receiving an input that includes text specification, FAP 
information, output synthesized voice (applicant's admitted prior art), phoneme output 
with addition information (applicant's admitted prior art modified by Merrill's teachings, 
Merrill et al, cols. 7-8, as pointed to above), generating a sequence of facial animation 
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parameters from signals of said second output (applicant's 'Merrill modified' admitted 
prior art), and rendering images from the output signal and combining the synthesized 
voice and images (applicant's fig. 1, FRM, synthesizer, and compositor). 

As per claims 44 and 58, applicant's admitted prior art teaches receiving the 
input from a remote locations via a network 

As per claims 45 and 59, the combination of Applicant's Admitted Prior Art in 
view of Merrill et al (6181351) teaches bookmarks marking phoneme boundaries (col. 14 lines 
65-68). 

As per claims 46 and 60, the combination of Applicant's Admitted Prior Art in 
view of Merrill et al (6181351) teaches information about the FAP's (applicant's admitted prior 
art of groupings of FAP's). 

As per claims 47 and 61, the combination of Applicant's Admitted Prior Art in 
view of Merrill et al (6181351) teaches amplitude information (applicant's admitted prior art, 
pp2 lines 10-13 of applicant's specification) 

As per claims 48 and 62, the combination of Applicant's Admitted Prior Art in 
view of Merrill et al (6181351) teaches duration (Merrill, col. 7 lines 5-11) 

As per claims 49-51 and 63-65, the combination of Applicant's Admitted Prior 
Art in view of Merrill et al (6181351) teaches a specified transition path, chosen by the 
animation module based on phoneme information via the bookmark (Merrill, col. 14 line 65 - 
col. 15 line 28). 



• ft 
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Response to Arguments 



5. Applicant's arguments with respect to claims 1-34,36-70 have been considered but are 
moot in view of the new ground(s) of rejection. 



Conclusion 



6. Any response to this action should be mailed to: 

Commissioner of Patents and Trademarks 
Washington, D.C. 20231 
or faxed to: 
(703) 872 9314, 

(for informal or draft communications, please label "PROPOSED" or "DRAFT") 
Hand-delivered responses should be brought to Crystal Park II, 2121 Crystal 
Drive, Arlington. VA., Sixth Floor (Receptionist). 

7. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Michael Opsasnick, telephone number (703)305-4089, who is 
available Tuesday-Thursday, 9AM-4PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Ms. Doris To, can be reached at (703)305-4827. The facsimile phone number for 
this group is (703)872-9314. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the Group 2600 receptionist whose telephone number is (703) 305-4750, 
the 2600 Customer Service telephone number is (703) 306-0377. 
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